Markov decision processes with quasi-hyperbolic discounting
نویسندگان
چکیده
منابع مشابه
Markov decision processes with exponentially representable discounting
We generalize the geometric discount of finite discounted cost Markov Decision Processes to “exponentially representable” discount functions, prove existence of optimal policies which are stationary from some time N onward, and provide an algorithm for their computation. Outside this class, optimal “N-stationary” policies in general do not exist.
متن کاملContinuous Markov equilibria with quasi-geometric discounting
We prove that the standard quasi-geometric discounting model used in dynamic consumer theory and political economics does not possess continuous Markov perfect equilibria (MPE) if there is a strictly positive lower bound on wealth. We also show that, at points of discontinuity, the decision maker strictly prefers lotteries over the next period’s assets. We then extend the standard model to have...
متن کاملQuasi-Deterministic Partially Observable Markov Decision Processes
We study a subclass of POMDPs, called quasi-deterministic POMDPs (QDET-POMDPs), characterized by deterministic actions and stochastic observations. While this framework does not model the same general problems as POMDPs, they still capture a number of interesting and challenging problems and, in some cases, have interesting properties. By studying the observability available in this subclass, w...
متن کاملA Simple Axiomatization of Quasi-hyperbolic Discounting∗
This paper provides a novel axiomatization of quasi-hyperbolic discounting, which imposes consistency restrictions directly on the intertemporal tradeoffs. The experimental design proposed in this paper will be useful for experimental work since it renders the short-run discount factor elicitation independent of the utility function. This makes comparisons of impatience across a spectrum of dif...
متن کاملAxiomatization and Measurement of Quasi-hyperbolic Discounting*
This article provides an axiomatic characterization of quasi-hyperbolic discounting and a more general class of semi-hyperbolic preferences. We impose consistency restrictions directly on the intertemporal trade-offs by relying on what we call ‘‘annuity compensations.’’ Our axiomatization leads naturally to an experimental design that disentangles discounting from the elasticity of intertempora...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Finance and Stochastics
سال: 2020
ISSN: 0949-2984,1432-1122
DOI: 10.1007/s00780-020-00443-2